Nonparametric estimation and adaptive control in a class of finite Markov decision chains

We consider a class of Markov decision processes withfinite state and action spaces which, essentially, is determined by the following condition: The state space isirreducible under the action of any stationary policy. However, except by this restriction, the transition law iscompletely unknown to the controller. In this context, we find a set of policies under which thefrequency estimators of the transition law are strongly consistent and then, this result is applied to constructadaptive asymptotically discount-optimal policies.Dedicated to Professor Truman O. Lewis, on the occasion of his sixtieth birthdayThis research was supported in part by the Third World Academy of Sciences (TWAS) under Grant TWAS RG MP 898-152, and in part by the Consejo Nacional de Ciencia y Tecnología (CONACYT) under Grant A128CCOEO550 (MT-2).     

Density estimation and adaptive control of markov processes: Average and discounted criteria

We consider a class of discrete-time Markov control processes with Borel state and action spaces, and ^d i.i.d. disturbances with unknown distribution . Under mild semi-continuity and compactness conditions, and assuming that is absolutely continuous with respect to Lebesgue measure, we establish the existence of adaptive control policies which are (1) optimal for the average-reward criterion, and (2) asymptotically optimal in the discounted case. Our results are obtained by taking advantage of some well-known facts in the theory of density estimation. This approach allows us to avoid restrictive conditions on the state space and/or on the system's transition law imposed in recent works, and on the other hand, it clearly shows the way to other applications of nonparametric (density) estimation to adaptive control.Research partially supported by The Third World Academy of Sciences under Research Grant No. MP 898-152.     

Palladium catalyzed Heck reaction of arenediazonium tetrafluoroborate salts with Baylis-Hillman adducts: production of α-benzyl-β-keto esters

A novel experimental procedure to obtain α-benzyl-β-keto esters from the Heck reaction between arenediazonium tetrafluoroborate salts and Baylis-Hillman (BH) adducts in the presence of Pd(OAc)₂ as catalyst is described. The methodology is simple, straightforward and the use of arenediazonium salts as opposed to conventional arylhalides/triflates over the usual Heck reaction is highlighted.     

Effects of Total Thermal Balance on the Thermal Energy Absorbed or Released by a High-Temperature Phase Change Material

Front tracking and enthalpy methods used to study phase change processes are based on a local thermal energy balance at the liquid–solid interface where mass accommodation methods are also used to account for the density change during the phase transition. Recently, it has been shown that a local thermal balance at the interface does not reproduce the thermodynamic equilibrium in adiabatic systems. Total thermal balance through the entire liquid–solid system can predict the correct thermodynamic equilibrium values of melted (solidified) mass, system size, and interface position. In this work, total thermal balance is applied to systems with isothermal–adiabatic boundary conditions to estimate the sensible and latent heat stored (released) by KNO3 and KNO3/NaNO3 salts which are used as high-temperature phase change materials. Relative percent differences between the solutions obtained with a local thermal balance at the interface and a total thermal balance for the thermal energy absorbed or released by high-temperature phase change materials are obtained. According to the total thermal balance proposed, a correction to the liquid–solid interface dynamics is introduced, which accounts for an extra amount of energy absorbed or released during the phase transition. It is shown that melting or solidification rates are modified by using a total thermal balance through the entire system. Finally, the numerical and semi-analytical methods illustrate that volume changes and the fraction of melted (solidified) solid (liquid) estimated through a local thermal balance at the interface are not invariant in adiabatic systems. The invariance of numerical and semi-analytical solutions in adiabatic systems is significantly improved through the proposed model.     

The CuII−CuI−Cu0(Hg) system in the presence of benzotriazole: Part II. A chronocoulometric investigation

Both the oxidation of Cu⁰ at dropping amalgam electrodes immersed in solutions of benzotriazole (BTA) and the reduction of Cu^II at a dropping mercury electrode from BTA solutions have been investigated by the single potential-step chronocoulometric technique. The dependence of the charge Q(t) flowing as a consequence of a given potential jump E_i→E_f upon the initial and final potentials E_i and E_f, as well as upon the time t elapsed from the instant of the potential jump provides direct evidence for the presence of a single adsorbed monolayer of a Cu^I compound on a mercury electrode immersed in a Cu^II solution containing BTA, at applied potentials positive to ≈?0.4 V/SCE. Analogous measurements carried out at dropping amalgam electrodes reveal the presence of a single adsorbed monolayer of a Cu^I compound, or else of an adsorbed multilayer, depending on the potential range investigated. The results of the chronocoulometric measurements are in agreement with those of the polarographic measurements of Part I.     

Comparison of low-energy CAD spectra of sulphonium,ammonium and phosphonium cations,propene elimination from allyl-substituted oniums

The low-energy collision-activated dissociation of symmetrical n-butyl-substituted and of allyl-substituted onium cations has been recorded using fast atom bombardment ionization and a tandem mass spectrometry quadrupole mass spectrometer. Structure of the fragments and decomposition pathways have been ascertained using a multi-quadrupole MS/MS/MS triple analyser instrument. Whereas most sulphonium cations exhibit only heterolytic cleavages, fragmentation of ammonium and phosphonium is mainly homolytic. Allylic sulphonium, and to a lesser extent allylic ammonium, easily undergo propene elimination. This reaction, which does not occur in 1-propenyl oniums, might involve a McLafferty type rearrangement.     

Plasma antioxidant capacity determination: comparative evaluation of chemiluminescent and spectrophotometric assays

All aerobic organisms have developed different mechanisms for neutralising the free radicals, mostly produced by the monoelectronic reduction of O(2), and preventing the severe damages these can provoke. The efficiency of these mechanisms can be assessed, in different matrices, by a simple and direct chemiluminescent assay (CL) based on luminol oxidation catalysed by horseradish peroxidase. Light emission is mediated by the production of free radicals and it is inhibited after a sample addition in a way that is directly proportional to the sample total content of molecules displaying antioxidant activity. The performances of this chemiluminescent assay were compared with those of two spectrophotometric methods already applied in clinical practice. First spectrophotometric method measures, like CL assay, the total antioxidant capacity, whereas the second one determines free thiol groups content. The chemiluminescent assay has a linearity interval between 0.60 and 9.46 mumol l(-1) of Trolox (y=34.91x+3.10; r=0.999; n=5) with an imprecision, expressed as CV, of 3.8% and an inaccuracy, expressed as percentage recovery, of 109%. The first spectrophotometric method, based on the same reference standard, the Trolox molecule, has a linearity interval between 0.2 and 2.5 mmol l(-1) of Trolox (y=-0.01x+4.54; r=0.95; n=5); the thiol groups assay has a linearity interval between 0.1 and 1 mmol l(-1) of l-cysteine (y=1.68x-47.09; r=0.998; n=5). Different clinical samples of plasma from healthy individuals, obese subjects and patients with liver diseases were tested. Interesting correlations were obtained among the three methods, but no significant correlations emerged between antioxidant capacity and clinical parameters. Significant differences were there only between men and women among obese subjects and between drinkers and non-drinkers among liver disease patients.     

Photoinduced electroreduction of chlorophyllide on alkanethiol-coated mercury

Monolayers of n-alkanethiols of chain length from C12 to C18 were self-assembled on a hanging mercury drop electrode, and a film of chlorophyllide (Chlide) was adsorbed on top of them. The reduction photocurrents following illumination of the Chlide film were measured over the potential range in which the Chlide is electroinactive in the dark, and their action spectra were determined. Plotting the derivative of the photocurrents with respect to the applied potential against potential yields bell-shaped curves that can be fitted to a Gaussian. The potential of the Gaussian maximum was used to determine the reorganization energy lambda for the Chlide electroreduction process. An increase in the thiol chain length causes lambda to decrease regularly and the photocurrent to decay exponentially with the monolayer thickness, with a decay constant beta of about 0.17 A(-1).     

Efficient assignment of the temperature set for Parallel Tempering

We propose a simple algorithm able to identify a set of temperatures for a Parallel Tempering Monte Carlo simulation, that maximizes the probability that the configurations drift across all temperature values, from the coldest to the hottest ones, and vice versa. The proposed algorithm starts from data gathered from relatively short Monte Carlo simulations and is straightforward to implement. We assess its effectiveness on a test case simulation of an Edwards–Anderson spin glass on a lattice of 12³ sites.